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(54) Method and system for search and retrieval of similar patterns 



(57) A method for retrieving digital patterns similar 
to a query pattem operates by generating representa- 
tions of each digital pattern in terms of one or more color 
invariant properties; storing and organizing the patterns 
and their representations in a database; and searching 
the database by reference to the representations to 
identify and retrieve patterns similarto the query pattem. 
A preferred color invariant property is an edge property 
of the digital patterns. A web-based pattem registration 
and searching architecture enables on-line pattern 
search and selection utilizing a variety of pattern repre- 
sentations and similarity techniques, including the edge 
property based system described above. 



mPOT 
PATTERNS 



QUERY 
PATTERN 




COLOR INVARIANT PROPERTIES 



1 



PATTERN DATABASE 
ORGANIZATION AND SEARCH 



CANDIDATE SIMILAR PATTERNS 

* 



SIMILAR PATTERN IDENTIFlOXnON 
AND RANKING 



SIMILAR PATTERNS 



FIG. I 



Printed by Jouve. 75001 PARIS (FR) 



EP 1 128 282 A2 



Description 

[0001 1 The Invention relates generally to the field of pattern recognition, and in particular to the retrieval of patterns 
from a database. 

[0002] Patterns are central to the design of fabrics, textiles, wallpapers, floor mats, tiles, etc. A pattern is composed 
of various pattem elements. A common approach to generating different versions of a pattern is to vary the color of 
one or more pattern elements. For example, several versions of a Vi* vertical stripe pattern can be created by using 
different combinations of two or more colors. The differently colored versions of a pattem are considered perceptually 
similar in connection with numerous applications. For example, it is common for a fabric designer or manufacturer to 
offer Its customer a large selection of colored patterns, where the entire set is composed of perceptually similar patterns 
which vary only on the basis of color. The same is true for other colored pattem-based items. A furniture store offers 
Its customer a choice of similar fabric patterns for furniture. An interior decorator or home manufacturer can offer a 
selection of similar pattems for wallpaper, tiles, etc. 

[0003] In recent years, several commercial software and web-based services have been introduced in areas lilce 
interior decoration and made to order furniture or clothing, where a customer is required to select a pattem for one or 
more items. For example, a customer can create virtual 3-dimensional furniture with the desired fabric(s) in a selected 
pattem or create and decorate a virtual 3-dimenslonal room with selected furnlture(s). wallpaper(s), flooring(s) etc A 
virtual item can be created with different patterns or different versions of a selected pattem in order to make' a final 
selection for custom ordering. In these situations, a customer or user commonly wants to view one or more versions 
of a selected pattern In order to make the final selection. For example, a decision on wallpaper may require a customer 
to view one or more of different available versions of a desired pattern. In these and similar applications, a person 
making a final decision on the pattern of an item generally employs a two step process for the selection of a specific 
pattem. First, a desired pattem is selected or provided. Then a version of the selected or provided pattern is selected 
The second step of the selection process, that is. the selection of a specific version of a selected or provided pattem 
requires a decision-maker to view different versions of the selected or provided pattern. 

[0004] Cu rrent software or web-based systems and applications generally employ one of the following two approach- 
es for identifying pattems that are perceptually similar to a given pattern: 

(a) predefined groups of perceptually similar patterns are stored In the system, with each pattern including a ref- 
erence to the parent group with which it is also associated. Given a pattern, the referenced group provides the 
perceptually similar patterns; 

(b) a user is required to review an entire database to identify different versions of the selected or provided pattem. 

Both these approaches have several shortcomings. For a sizable pattem database, the second approach can be very 
taxing and frustrating for a user. The first approach is very taxing for the system and/or pattern designer who define 
(s) the groups of perceptually similar pattems. Mistakes made in defining the groups could lead to unexpected results 
and customer dissatisfaction. Furthemiore. the addition and/or deletion of new pattems requires modification of the 
pattem groups, whteh may prove to be commercially uneconomical and/or impractical. 

[0005] Therefore, automatic, feature similarity based pattern search and retrieval systems are needed for identifying 
perceptually similar pattems. However, none of the existing feature similarity based search and retrieval techniques 
are well suited for automatic pattem similarity-based search and retrieval. In U.S. Patent Nos. 6.579,471 ; 5.852 823 
and 5,893,095, search and retrieval techniques are based on colorfeature similarity. In a system for selecting decorative 
materials described in U.S. Patent No. 5.751.829, spectrophotometric color referencing allows data records to be 
searched on the basis of color, as well as other infomaation that was entered into the record. Wallpaper pattems drapery 
matenal, floor covering or paint can then be selected on the basis of matching color. Various patterns and paints can 
be compared side-by-side and rendered onto a room image so that the consumer can view an accurate simulation of 
the chosen materials. However, colorfeature similarity-based methods described in these patents are not suited be- 
cause they Identify similar images based on the similarity of color contents or color properties. Since color properties 
of different versions of the same patterns usually vary, color similarity cannot be employed to identify and retrieve 
similar pattems. Texture feature based methods disclosed in the first three patents are not suited because they deter- 
mine image similarity in terms of monochromatic textural properties of pattems. Since several different colors reduce 
to the same monochromatic value, the pattems in the monochromatic versions of two different color versions of the 
same pattem can differ and hence would not be considered similar. 

[0006] What is needed, since color and texture properties of different versions of the same patterns usually vary is 
a system that can be employed to Identify and retrieve similar patterns irrespective of color variations 
[0007] It is an object of the invention to provide a system and a method for automatic search and retrieval of pattems 
similar to a given pattern. 

[0008] Assuming that each colored pattem is available as a digital Image, it is a further object of the invention to 
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provide for automatic search and retrieval of digital images that are computer generated synthetic images of patterns 
or digital Images of full pattems from the actual items (i.e., fabric, tile, or wallpaper). 

[0009] The present invention is directed to overcoming one or more of the problems set forth above. Briefly summa- 
rized, according to one aspect of the present invention, the invention includes a method for retrieving digital pattems 

5 similar to a query pattem by generating representations of each digital pattern in terms of one or more color invariant 
properties; storing and organizing the pattems and their representations In a database; and searching the database 
by reference to the representations to identify and retrieve patterns similar to the query pattern. A preferred color 
invariant property is an edge property of each digital pattem, and more particularly its edge orientation. 
[0010] The advantage of this invention is that it provides a system for organizing a database of pattems by color 

10 invariant properties, such as an edge property. Pattems and colors are crucial to the design of wallpapers, fabrics, 
textiles, floor mats, tile, rugs, etc. These Items are usually available In different colored versions of the same pattem. 
In other words, different versions of the same pattern are created using different colors for the pattern elements. What 
this means is that different colored versions of a pattem are considered to be similar patterns. In applications such as 
fabric selection for furniture or clothing, wallpapers, floor mats, rugs, window treatments, and tile selection in an interior 

15 decoration application, different colored versions of a selected pattem are usually reviewed. Such a review requires 
identification and retrieval of the set of pattems similar to a selected pattern, and at least initially Irrespective of color. 
[0011] These and other aspects, objects, features and advantages of the present invention will be more clearly 
understood and appreciated from a review of the following detailed description of the preferred embodiments and 
appended claims, and by reference to the accompanying drawings. 

?o [0012] FIG. 1 is a block diagram of the functional components of the invention. 

[0013] FIG. 2A is a block diagram of a computer system for implementing the Invention. 

[0014] FIG. 2B is a block diagram of a client • server model useful in understanding a web-based implementation of 
the Invention. 

[0015] FIG. 3 is a chart of the pattem feature extraction and representation component shown in Figure 1 . 
25 [001 6] FIG. 4 Is a chart of the database organization and search component shown in Figure 1 . 

[0017] FIG. 5 is a chart of the similar pattem identification and ranking component shown in Figure 1 . 
[0018] FIG. 6 is a diagram of a window centered at pixel location [x.y]. 

[0019] FIG. 7 is an example of a histogram showing relative frequency of occurrence of edge orientations. 
[0020] FIG. 8 is an example of a co-occurrence histogram showing relative frequency of occurrence of an edge with 
30 an given orientation neighboring an edge with another orientation. 

[0021] FIG. 9 is an illustration of a web-based pattern registration and searching architecture for on-line pattern 
search and selection. 

[0022] Because image processing systems employing search and retrieval strategies are well known, the present 
description will be directed in particular to attributes forming part of, or cooperating more directly with, apparatus in 

35 accordance with the present invention. System attributes not specifically shown or described herein may be selected 
from those known in the art. In the following description, a preferred embodiment of the present invention would ordi- 
narily be implemented as a software program, although those skilled in the art will readily recognize that the equivalent 
of such software may also be constructed in hardware. Given the system and methodology as described in the following 
materials, all such software Implementation needed for practice of the invention is conventional and within the ordinary 
o skill in such arts. If the invention \s implemented as a computer program, the program may be stored In conventional 
computer readable storage medium, which may comprise, for example; magnetic storage media such as a magnetic 
disk (such as a floppy disk) or magnetic tape; optical storage media such as an optical disc, optical tape, or machine 
readable bar code; solid state electronic storage devices such as random access memory (RAM), or read only memory 
(ROM); or any other physical device or medium employed to store a computer program. 

45 [0023] The subject matter of the present invention relates to digital image understanding technology, whfch is un- 
derstood to mean technology that digitally processes a digital image to recognize and thereby assign useful meaning 
to human understandable objects, attributes or conditions and then to utilize the results obtained in the further process- 
ing of the digital image. 

[0024] The system and method developed according to this invention is composed of three key functional compo- 
se nents, as shown in Figure 1 : 

(a) A pattern representation component 2, where each digital pattem is represented by a set of its properties that 
are invariant to color changes. 

(b) A pattern database organization and search component 4, In which the database of pattems and their repre- 
55 sentations is organized so that it can be efficiently searched for patterns that are potentially similar to a selected 

or query pattern. These potentially similar patterns are considered candidate similar pattems. 

(c) A similar pattern identifrcation and ranking component 6, in which each pattern in the set of candidate similar 
pattems is processed to detemrilne its similarity with the query pattern. Candidates with similarity value less than 
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a specified threshold are discarded and the remaining candidates are ranked In the descending order of their 
similarity with the query pattern. 

[0025] While the overall methodology of the invention is described herein, the invention can be embodied In any 
number of different types of systems and executed in any number of different ways, as would be known by one ordinarily 
skilled in the art. For example, as illustrated in Figure 2A. a typteal hardware configuration of an Infomiation handling/ 
computer system 8 In accordance with the Invention preferably has at least one processor or central processing unit 
(CPU) 10. The CPU 10 is Interconnected via a system bus 12 to a random access memory (RAM) 14, a read-only 
memory (ROM) 1 6, an inpuVoutput (I/O) adapter 1 8 (for connecting peripheral devices such as disk units 20 and tape 
drives 22 to the bus 1 2), a communication adapter 24 (for connecting an infomiation handling system to a data process- 
ing network), a user interface adapter 26 (for connecting peripherals 28, 30. 32 such as a keyboard, a mouse, a digital 
Image Input unit such as a scanner, and/or other user Interface device to the bus 12), a printer 34 and a display adapter 
36 (for connecting the bus 12 to a display device 38). The Invention could be implemented using the structure shown 
in Figure 2A by including the inventive method within a computer program stored on the storage device 20. A query 
design pattern could be entered Into the system through the scanner 32. Such a computer program would act on a 
stored grouping of Image designs supplied from a database 40 through the Interface adapter 18 or from a remote 
database through the network connection provided by the communication adapter 24. The system would then auto- 
matically implement the pattern search and retrieval process and produce the desired digital image output on the 
display 38, or the printer 34 or communicate the image output through the connection provided by the communication 
20 adapter 24. 

[0026] In a web based environment following a client - server model as shown in Figure 2B, the system 8 shown In 
Figure 2A would correspond to a client computer 8*, and Its communication adapter 24 would establish a network 
connection 42 to a server computer 44 over an internet service connection. A remote database 46 either resident on 
the server computer 44 or accessible from the sen/er computer 44 would contain the database of pattems. In typical 
world wide web operation, the client computer 8' would run a web browser (e.g., stored locally in RAM 14) that woukJ 
establish the internet connection via conventional HTTP protocol to a web server program at the remote server computer 
site; HTML fomis-based Interchange would then be established between the server computer 44 and the client com- 
puter 8' to access the database 46. 

[0027] Referring now in particular to Figures 3, 4 and 5 the details of each component are as follows. 
Pattern Representation: For each digital pattern in the database 40 (or 46), a representation Is automatteally extracted 
by processing the digital image of the pattern to be stored In the database. Since the contours or edges that form a 
pattem are invariant to color changes, the prefen-ed implementation represents a digital pattem by the properties of it 
edges. Therefore, first the color edges are detected. Any of the several available edge detection techniques can be 
used to automatically detect the edges. In the preferred implementation any one of the following options can be selected 
for the edge detection. Consider a 3-channel colored digital pattem. First the inter-pixel color change forthe three color 
channels is computed by passing a window at location [x. >]. as shown In Figure 6, over the digital image of the input 
design. Referring to the flow chart In Figure 3, for a RGB color pattem Image, the change in color value is computed 
In a step 1 GO as follows for a pixel at location [x. >]: 
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DR^ = /?[x-1.y-1]+/?[x-1 ,y]+fl[x-1,y+1]-fl[x+1,y-1]-fl[x+1 ,y]-/?[x+1,y+1] 
DG^ = G[x-1 ,y.1]+G[x-1 .yl+G[x-1 .y+1]-G[x+1 .y-1]-G[x+1 ,y]-G[x+1 .y+1] 
45 ^^x = ^^-1 .y-1]+S[x-1 .y]+B[x.1.y+1]-e[x+1.y.1]-B[x+1 ,y]-Stx+1 .y+1] 

DRy = /?[x-1 ,y-1]+/?[x,y.1]+/?[x+1,y-1]-/?[x-1 .y+1]-R[x,y+1].R[x+1,y+1] 
DGy = G[x-1,y-1]+G[x,y-1J+G[x+1,y-1]-G[x-1.y+1]-G[x.y+1].G[x+1.y+1] 
DRy = e[x-1 ,y-1]+BIx,y-l]+B[x+1 ,y-1]-S[x-1 .y+1]-S[x,y+l].e[x+1.y+l] 

Then the pixel at location [x,y[ Is considered an edge using one of the following options: 
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Option 1 : If maximum of {DR^, DR DG^ DG DB^ DBy) exceeds a specified threshold. 
Option 2: If 
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exceeds a specified threshold. 

Option 3: If D = maximum of {DRj^+DRy, DG^-hDGy, DB^+DB^ exceeds a specified threshold. 

[0028] Note that a similar method can be used for digital patterns in other multi-channel color spaces. Further note 
that any color edge detection method can be used to detect edges. 

[0029] After the pixel at location [x, y\ is determined to be an edge pixel, the edge property at that location must then 
be calculated. The edge property being calculated in a step 102 is the edge orientation/direction at that particular 
location. Edge orientation/direction is calculated using the following: 



IS 



-1 

e = tan ^ 



(1) 



?0 



where Dy and can be calculated using one of the following options: 



Option 1 : 
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Dy = Wf^DRy + v/QDGy + WgDBy 



30 



Where DR^p DRy, DG^ DGy, DBj^ DGy are as defined above, and iv^, Wq, and Wq are the relative weights associated 
with the changes in the red, green, and blue color channels, respectively. In this option, the changes in the xand 
y direction are calculated as the weighted sum of the changes in each color plane. 

Option 2: 
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DR if FR = max(Fi?, FG, FB) 
i DG if FG = max(F/?,FG,FB) 
DB if FB = max(FR, FG.FB) 



'-O 



where 



FR = ^DfF^ + DfF . FG = Jd^Vd^ . FB = JdB^^ + DBy 
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DR, 
DR 



DG 




DB 




55 



Those skilled in the art would recognize that any variation of the above two options is possible for the calculation 
of edge orientation/direction. 

[0030] After the edge properties at alt edge locations are calculated, the digital pattern is represented in a histogram 
population in terms of these edge properties. There are two options available in the preferred system for the represen- 
tation of a digital pattern in terms of Its edge properties: 
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1. Global property based representation - In this option, as expressed in a step 104, a digital pattern Is repre- 
sented by the global properties of edges or contours of the pattern. In this preferred implementation, a pattern is 
represented in a histogram population such as shown In Figure 7 by the distribution of edge directions or orienta- 
tions in the pattern. In simple tenns, for a total number of N distinct possible orientation values, a pattern is rep- 
resented by a function ^6]. 6=0. ..,.N■^ , where 6 denotes the edge orientation generated by the edge orientation 
equation (1) and ^0] denote the probability or relative frequency of occurrence of an edge with orientation 6 In 
the prefenred embodiment the values of £[6] are normalized so that the sum of all values for a pattem is 1 • In 
addition, each integer value of e represents a grouping of angles, e.g., N = 1 represents orientation angles of'o - 
10 , N = 2 represents orientation angles of 11» - 20". N = 3 represents 21' - 30«. and so on. 

2. Local property based representation - In this option, as expressed in step 106. a digital pattem is represen- 
tation by the local properties of detected edge or contour points. In the preferred implementation, a pattem is 
represented In a histogram population by the distribution of edge orientations for co-occurring edge points such 
as shown in Figure 8. In simple temis, for a total number of N distinct possible orientation values, a pattem Is 
represented by a function /=[91 . 62], 61 = 0, ...N-1. 62 = 0. ...N-1 and ^61 . 62) denotes the probability or relative 
frequency that an edge with the orientation 61 neighbors an edge with the orientation 82. As shown in Figure 8 
the onentation co-occurrence histogram is a three-dimensional representation indexed by orientation between co- 
occumng pixels which depicts the spatial correlation of orientation. This representation approach captures the 
local structure properties of a pattem. In the prefen^ed embodiment the values of fiei , 621 are normalized so that 
the sum of all values for a pattem is 1 . 

[0031] Those skilled in art would recognize that other variations of the above two options are possible Each digital 
pattem and all, or a dominant portion of. the associated representations m. ^61 , 62] are stored in the database In 
the preferred Implementation, the value of N is selected to be 36. 

Pattern Database Organization and Search: For a small database, the representation of the query pattem is com- 
pared against the representation of each of the pattems in the database. A pattem whose similarity with the auerv 
patterns exceeds a specified threshold Is selected as a similar pattem. The selected similar pattems are ranked in 
decreasing order of their similarity with the query pattern. 

[0032] For a large database of pattems. an option exists as shown in Figure 4 to organize the pattem representations 

in an efficient index structure. The purpose of the index structure is to facilitate effkdent search of the database for )^cUx 

similar patterns. Given a query pattem representation, the index structure is searched first to identify candidate similar , 

pattems. so that only those candidate pattems need to be further examined using more detailed similarity comparison 

techniques. 

[0033] Index structures are constructed from pattems and their associated representations. However, due to the high 
dimensionality of typical pattem representations, typically, not the entire representation is entered into the index stmc- 
ture. Usually, lower-dimensional data, called index keys, are generated from the representations, and are used for 
indexing. The keys of similar patterns typtealiy cluster together in the index stmcture. When a query is posed those 
pattems whose keys fall within the same cluster in the index structure as the keys of the query pattem will be consWered 
as candidate similar patterns. 

[0034] In the present Implementation, corresponding to the two options for pattem representation, there are two 

representation, theset of the first K most dominant 
onentrtions (those orientations having the highest relative frequency of occurrence) of a pattem representation Is used 
as the key for the pattem. In case of ties (i.e. two orientations having the same relative frequency of occun-ence) all 
possible combinations of keys are created. For example. If K=3. and the first and second most dominant orientation 
are 10 degrees and 50 degrees, and there is a tie for the third most dominant orientation between 30 degrees and 70 
degrees, then two keys will be generated; {10. SO. 30), and {10, 50. 70}. In the preferred implementation, K has to be 
less than or equal to 6. For the local edge property based representation option, the set of T most dominant edqe 
onentation pairs Is selected as the key for a pattem. The ties are resolved by creating all possible keys in a similar 
manner as described above. In the prefened implementation, T is required to be less than or equal to 3 
[0035] Refen-lng now to Figure 4, during database organization, the Index keys are generated as above indtoated In 
step 1 1 0 of index key generation for the patterns in the database. During pattem registration or organization, as shown 
in step 112. the keys of each pattem in the database are inserted Into the index stmcture. In the Index structure the 
keys are organized in an efficient manner to facilitate later search. Any multidimensional index structure can be used 
for organizing the keys. In the present Implementation, the keys are organized In an R-tree. Each leaf node of the R- 
tree index contains a key X, and a link referring to a list of pattems whose representation woukj generate X as one of 
the keys. Each pattem representation further refers to the digital image of the pattem. During pattem search or quen/ 
given a query pattem representation, first all its keys are generated in step 114. For each key of the query pattern the 
index stmcture is searched In step 116. The set of pattems whose keys occupy the leaf node where a search tenninktes 
in the index structure is added In step 118 to the set of candidate similar pattems. Atter searching the index for every 
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key generated by the query pattern, we obtain the final set of candidates. This set of candidates is further processed 
using more detailed methods to identify the similar patterns and to rank them in the decreasing order of their similarity 
with the query pattem, as described in the following section. 

Similar Pattern Identification and Ranking: As shown in Figure 5, each of the representations of a candidate pattern 
c is compared with the representations of the query pattern qXo compute their similarity S(c,q). The pattern identification 
and ranking begins in step 130 with the representation of the query design, as described in relation to step 114 of 
Figure 4. Then the database of patterns is searched in step 132 as described In relation to steps 116 and 118 in Figure 
4. Similarity is evaluated in step 134 according to the following metrics, any one of which can be used in the present 
implementation: 



(b) Sicg)^ ^\-\K[2]-Jt,[zi 



(c) 5(c,o) = 



.9) = 7^ S 



min(/g,[z]>/gjz]) 
max(/?,[z],/?Jz]) 



Where RJ,]an6 R^J denote the values of a component of the patterns of candidate pattem cand query pattem q, 
respectively; L is the total number of components in the representation. L = Ntor the global property based pattern 
representation and L=N^ tor the local property based pattern representation. For example, in metric (a) the represen- 

00 tation values and for each orientation component are compared and the minimum values thereof are summed 
for the respective patterns for both global properties and local properties. The value of S(c,q) is in range [0, 1], where 
1 indicates self identity. If the S(c,q) exceeds a specified threshold, the candidate pattem c is considered similar to 
query pattern q and is added in step 136 to the set of similar patterns in the sorted order Otherwise, the candidate is 
discarded. Note that other similarity metrics can also be employed within the scope of this invention. 

35 [0036] The aforementioned set of similar patterns In their sorted order represent different versions similar to the 
selected query pattern. In applications such as fabric selection for furniture or clothing, wallpapers, floor mats, rugs, 
window treatments, and tile selection in an interior decoration application, it is important that different colored versions 
of a selected pattern may be retrieved and reviewed. Such a review requires identification and retrieval of the set of 
patterns similar to a selected pattern, in which each digital pattern is represented In the database in temris of color 
invariant properties for purposes of search and retrieval. This invention provides such a system for organizing a data- 
base of patterns using an edge property based representation for each pattern. 

[0037] In a different aspect of the invention, a web-based pattem registration and searching architecture enables 
on-line pattem search and selection utilizing a variety of pattern representations and similarity techniques, including 
the edge property based system described above. Further details of a typical client - sender setting for a web-based 

45 architecture are shown in Figure 9, which shows a server host 50 interconnected via a network (e.g., the Internet) with 
a client host 52. Following an appropriate establishment of communication between the client host and the server host, 
a swatch server 54 is run on the server host 50, and a web browser 56 running on the client host 52 causes display 
of a "swatches" web page generated by an applet 58. The client application functionality Is Incorporated into the applet, 
whteh is loaded and run in the web browser 56 and displayed via the applet onto the web browser 56. A user at the 

so client host 52 selects a particular pattem in a swatch grid 60 and clicks on a match button 62, which causes the applet 
58 to instnjct the web browser 56 to execute a request to the swatch server 54 to find patterns matching the selected 
pattem. The swatch server initiates communications with a visual information manager 64, which contains a database 
of patterns, and which may be indexed according to the invention or by any other conventional indexing architecture. 
The pattem representation algorithm and the searching methodology, such as the algorithm and methodology disclosed 

55 herein, is included in the visual infonnation manager 64. The visual information manager 64 performs the appropriate 
functions and returns the appropriate response, namely, the list of similar patterns, to the swatch server 54, which in 
turn causes the swatch server to return the response to the applet 58. The applet generates the final web page to be 
displayed in the web browser 56. A user at the client host 52 can elect to upload a particular swatch into the database 
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of patterns residing in the visual information manager by clicking the upload button 66; this pattern would then be 
uploaded from a storage device accessible to the user, and may have been provided from a variety of sources, including 
the scanning of a swatch by the input scanner 32 shown in Figure 2. The request is communicated from the web 
browser 56 to the swatch server 54 and in turn to the visual information manager 64, where the representation for the 
5 uploaded pattern is calculated and the uploaded pattern and all its corresponding information are properly stored into 
the database of patterns as described herein. While the web-based architecture described above generates web pages 
via applets, it should be understood that other means of web page generation, such as via CGI script, can also be 
utilized in accordance with the invention. 

[0038] While the pattern representation algorithm, and the indexing and searching methodology, is preferably as 
10 described herein, it should be understood that other algorithms and methodologies may be incorporated in practice of 
the web-based pattern registration and searching architecture In accordance with the invention. 
[0039] The invention has been described with reference to a preferred embodiment. However, it will be appreciated 
. that variations and modifications can be effected by a person of ordinary skill In the art without departing from the scope 
of the invention. 
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Claims 

1 . A method for retrieving digital patterns similar to a query pattern selected by a user, said method comprising the 
20 steps of: 

(a) generating representations of each digital pattern in terms of one or more color invariant properties; 

(b) storing and organizing the patterns and their representations in a database; and 

(c) searching the database by reference to the representations to identify and retrieve patterns similar to the 
25 query pattem. 

2- The method as claimed in claim 1 wherein step (b) of storing and organizing the patterns and their representations 
in the database includes organizing the representations in an index structure. 

30 3. The method as claimed in claim 2 wherein the step (c) of searching the database includes: 

(a) searching the index structure to identify a set of candidate patterns; and 

(b) analyzing the set of candidate patterns to identify the patterns similar to the query pattern. 

35 4. The method as claimed in claim 1 further including the step of ranking the retrieved patterns in a sorted order of 
their similarity with respect to the query pattern. 

5. The method as claimed in claim 1 wherein the step (a) of generating representations of each digital pattem In 
terms of color invariant properties includes generating representations of each digital pattem in temis of its edge 

40 properties. 

6. The method as claimed in claim 5 wherein each digital pattem is represented In terms of edge orientations. 

7. A web-based program tool that assists in the review and selection of patterns by utilizing the method as claimed 
45 In claim 1 to automatically identify and retrieve patterns similar to a selected pattern. 

8. A method of database organization for a plurality of digital pattems, said method comprising the steps of: 

(a) generating representations of each digital pattem in terms of one or more color invariant properties; and 
50 (b) organizing the database of digital pattems in terms of the representations. 

9. The method as claimed in claim 8 wherein step (b) of organizing the database in terms of the representations 
includes organizing the representations in an index structure. 

ss 10. The method as claimed in claim 8 wherein the step (a) of generating representations of each digital pattem in 
terms of color Invariant properties includes generating representations of each digital pattem in terms of its edge 
properties. 
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11. The method as claimed in claim 10 wherein each digital pattern is represented in terms of edge orientations. 

12. A system for retrieving digital patterns similar to a query pattern selected by a user, said system comprising: 

(a) a database of digital patterns; 

(b) a processing stage for generating representations of each digital pattern in terms of one or more color 
Invariant properties and organizing the patterns and their representations in a database organization; 

(c) a provision for storing the pattems and their representations in the database; and 

(d) a searching stage that searches the database by reference to the representations to identify and retrieve 
patterns similar to the query pattern. 

13. The system as claimed In claim 12 wherein the patterns and their representations are organized in an Index struc- 
ture and the searching stage includes a searching algorithm for searching the Index structure to Identify a set of 
candidate pattems and analyze the set of candidate pattems to identify the patterns simitar to the query pattern. 

14. The system as claimed in claim 12 wherein the search stage ranks the retrieved patterns In a sorted order of their 
similarity with respect to the query pattern. 

15. The system as claimed in claim 12 wherein the processing stage generates representations of each digital pattern 
In terms of one or more edge properties of each pattem. 

16. The system as claimed in claim 15 wherein the processing stage generates representations of each pattem In 
terms of edge orientations. 

17. A web-based program tool that assists in the review and selection of patterns by automatically identifying and 
retrieving patterns similar to a selected pattem. 

18. A web-based program tool that assists in the review and selection of fabric for clothing or furniture by automatically 
Identifying and retrieving clothing or furniture patterns similar to a selected pattern 

19. A web-based interior decoration program tool that assists in the review and selection of wallpaper, tile, floor treat- 
ment or window treatment by automatically identifying and retrieving wallpaper, tile, floor treatment or window 
treatment patterns similar to a selected pattem. 
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